Papers with Few-shot learning
Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering (2024.eacl-long)
Copied to clipboard
| Challenge: | Recent approaches to multi-hop question answering rely on in-context learning . however, these models contain billions of parameters making them inefficient at inference time. |
| Approach: | They propose a framework that allows for improving smaller language models with less than 10 human-annotated QA pairs by synthesizing millions of multi-hop questions and claims to fine tune language models. |
| Outcome: | The proposed framework improves model performance on multi-hop question answering and fact verification benchmarks while being almost one-third the size in parameter count. |
Few-shot Intent Classification and Slot Filling with Retrieved Examples (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot learning are based on labeled examples, but they are non-trivial . few-sshot learning is challenging due to the imbalance in the amount of data between the source and target domains. |
| Approach: | They propose retrieval-based methods for intent classification and slot filling tasks . they use a batch-softmax objective to learn similar contextualized representations for spans . |
| Outcome: | The proposed method outperforms previous systems on the CLINC and SNIPS benchmarks. |
Effective Few-Shot Classification with Transfer Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on few-shot learning addresses the problem of learning based on a small amount of training data. |
| Approach: | They adapt the Amazon Review Sentiment Classification (ARSC) text dataset for few-shot learning . they train a single binary classifier to learn all few- shot classes jointly . |
| Outcome: | The proposed approach outperforms most published results on the ARSC text dataset . the results suggest that the classes in the AR SC few-shot task are very similar to each other . |
SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking (2024.eacl-long)
Copied to clipboard
| Challenge: | In-context learning with Large Language Models (LLMs) is a promising avenue of research in Dialog State Tracking (DST). |
| Approach: | They propose a data generation framework tailored for Dialog State Tracking that uses large language models to synthesize natural, coherent, and free-flowing dialogues with DST annotations. |
| Outcome: | The proposed framework improves joint goal accuracy by 4-5% over the zero-shot baseline on MultiWOZ 2.1 and 2.4. |
Towards Few-shot Fact-Checking via Perplexity (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that pre-trained language models can perform few-shot learning for various downstream tasks, such as question answering and machine translation. |
| Approach: | They propose a method to leverage the powerful transfer learning ability of a language model via a perplexity score to learn few-shot for the fact-checking task. |
| Outcome: | The proposed method outperforms the Major Class baseline by 10% on the F1-Macro metric across multiple datasets. |
Making Language Models Better Reasoners with Step-Aware Verifier (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models have made impressive progress in few-shot learning but still face difficulties in reasoning tasks such as GSM8K. |
| Approach: | They propose a new approach that uses a verifier to filter out incorrect answers based on a weighted voting scheme to improve reasoning ability of language models. |
| Outcome: | The proposed approach improves GSM8K reasoning rate by 17.9% to 58.1%. |
Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference (2020.emnlp-main)
Copied to clipboard
Jianguo Zhang, Kazuma Hashimoto, Wenhao Liu, Chien-Sheng Wu, Yao Wan, Philip Yu, Richard Socher, Caiming Xiong
| Challenge: | Existing work on few-shot intent classification without OOS has focused on the few-shot intent classification with out-of-scope intents. |
| Approach: | They propose to use BERT-style pairwise encoding to train a binary classifier that estimates the best matched training example for a user input. |
| Outcome: | The proposed approach achieves more stable and accurate in-domain and OOS detection accuracy than RoBERTa-based classifiers and embedding-based nearest neighbor approaches. |
Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Relation extraction models require extensive annotated training data, which is costly and labor-intensive to collect. |
| Approach: | They propose a new zero-shot RE task where only relation definitions are provided instead of seen-unseen relation instances. |
| Outcome: | The proposed task significantly improves cost-effective zero-shot performance by large margins. |